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CLAIMS 

What is claimed is: 

1. A method of evaluating an analyst's performance, said method comprising the steps of: 
utilizing information pertaining to at least one revision made by the analyst involving at 

least one investment, including an upward or downward change in opinion of the analyst with 
regard to the at least one investment; 

calculating a conditional performance score indicative of the analyst's performance 
relative to other analysts, said raw conditional performance score determined at least in part by 
considering a measure of variability of the analyst's performance, an average historical 
performance of the at least one investment following the at least one revision, a standard 
deviation of the at least one revision, a number of revisions made by the analyst, and a likelihood 
that the at least one revision will actually produce an expected result; and 

adjusting said conditional performance score according to a return amount adjustment to 
produce a final performance score. 

2. The method of claim 1 , wherein the average historical performance of the at least one 
investment is considered over three distinct periods of time. 

3. The method of claim 2, wherein said three distinct periods of time comprise a short 
period of time which is approximately five days, an intermediate period of time which is 
approximately twenty days, and a long period of time which is approximately sixty days. 

4. The method of claim 1, wherein the final performance score increases with the number of 
revisions. 

5. The method of claim 1, wherein said revision comprises one of an upward revision or a 
downward revision. 
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6. The method of claim 1, wherein the final performance score increases when a rate of 
return of the at least one investment increases and the revision is an upward revision, or when a 
rate of return of the at least one investment decreases and the revision is a downward revision. 

7. The method of claim 1, wherein the final performance score decreases when a rate of 
return of the at least one investment decreases and the revision is an upward revision, or when a 
rate of return of the at least one investment increases and the revision is a downward revision. 

8. The method of claim 1, further comprising adjusting said conditional performance score 
according to a modifier accentuating the number of revisions made by the analyst. 

9. The method of claim 1, wherein said return amount adjustment comprises a small return 
penalty reducing said final performance score for returns on said at least one investment less than 
a predetermined amount. 



10. The method of claim 9, wherein said small return penalty is comprised of a difference 
between an average of a short period of time return factor, an intermediate period of time return 
factor, and a long period of time return factor, and a penalty; wherein said penalty is equal to 
approximately 15% for upward revisions and approximately -8% for downward revisions minus 
a return value corresponding to the investment for said long period of time; and wherein each 
period of time return factor is a cube root of a return percentage over a corresponding period of 
time. 



1 1. The method of claim 9, wherein said small return penalty is imposed for small returns 
over a long period of time of approximately sixty days after said at least one revision. 

12. The method of claim 9, wherein said small return penalty is generated by subtracting a 
penalty from an average of a first, second and third period of time return factor; wherein for 
upward revisions said penalty is 0 if an average return value corresponding to the investment for 
a long term period of time is greater than 15%, else said penalty is equal to 15% minus said 
average return value corresponding to the investment for a long term period of time; wherein for 
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downward revisions said penalty is 0 if said average return value corresponding to the 
investment for a long term period of time is less than -8%, else said penalty is equal to -8% 
minus said average return value corresponding to the investment for a long term period of time; 
wherein said first period of time return factor is ten if an average return over said first period of 
time is greater than ten, else said first period of time return factor is equal to a cube root of a 
product of 100 and said average return over said first period of time; wherein said second period 
of time return factor is ten if an average return over said second period of time is greater than ten, 
else said second period of time return factor is equal to a cube root of a product of 100 and said 
average return over said second period of time; and wherein said third period of time return 
factor is ten if an average return over said third period of time is greater than ten, else said third 
period of time return factor is equal to a cube root of a product of 100 and said average return 
over said third period of time. 

13. The method of claim 1, wherein said calculating a conditional performance score 
comprises: 

determining a first average return value (ave. returni), second average return value (ave. 
return 2 ), and third average return value (ave. return 3 ) for the at least one revision, said first, 
second, and third average return values corresponding respectively to an average rate of return 
on the at least one revision involving the investment for a first period of time (timeO, a second 
period of time (time 2 ), and a third period of time (time 3 ); 

calculating, in absolute terms, a first t-stat value (t-stati) for said first average return 
value, a second t-stat value (t-stat 2 ) for said second average return value, and a third t-stat value 
(t-stat 3 ) for said third average return value, said first, second, and third t-stat values calculated by 
utilizing said first, second, and third average return values, a first standard deviation (SDi), a 
second standard deviation (SD 2 ), and a third standard deviation (SD 3 ), a total number of 
revisions (revisionsO occurring more than or equal to the first period of time before said 
evaluating, a total number of revisions (revisions 2 ) occurring more than or equal to the second 
period of time before said evaluating, and a total number of revisions (revisions 3 ) occurring more 
than or equal to the third period of time before said evaluating; 
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calculating a first degree of freedom (DFO for said first average return value, a second 
degree of freedom (DF 2 ) for said second average return value, and a third degree of freedom 
(DF 3 ) for said third average return value; 

determining a first probability (probj) for said first period of time by utilizing said first t- 
stat value and said first degree of freedom, a second probability (prob 2 ) for said second period of 
time by utilizing said second t-stat value and said second degree of freedom, and a third 
probability (prob 3 ) for said third period of time by utilizing said third t-stat value and said third 
degree of freedom; 

generating a raw conditional performance score for the analyst by utilizing probi , prob 2 , 
andprobs; 

generating an adjustment to said raw conditional performance score by utilizing 
revisionsi, revisions 2 , and revisions 3 ; and 

adding said adjustment to said raw conditional performance score to produce said 
conditional performance score. 



14. The method of claim 13, wherein if SDi = 0, then conditional performance score = 0 
otherwise 



T stat\ 



ave. returnl 



SDI 



V revisionsl 



; wherein if SD 2 , = 0, then conditional performance score = 0 otherwise 

ave. return! 



T stah - 



SD2 



V revisionsl 



; wherein if SD 3 , = 0, then conditional performance score = 0 otherwise 

ave. return3 
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T stat?, - 



SD3 



V revisions3 
V J 

; wherein DFi = revisionsi - 1; DF 2 = revisions 2 - 1; and DF 3 = revisions 3 - 1 

15. The method of claim 13, wherein said probabilities are determined according to a 
predetermined look-up table using actual calculated values of: DFi, DF 2 , DF 3 , t-stati, t-stat 2 , and 
t-stat 3 , unless: DFi > 100, in which case DFi is set to 100; DF 2 > 100, in which case DF 2 is set to 
100; DF 3 > 100, in which case DF 3 is set to 100; t-stati > 20, in which case t-stati is set to 20; t- 
stat 2 > 20, in which case t-stat 2 is set to 20; t-stat 3 > 20, in which case t-stat 3 is set to 20; t-stati < 
.0.01, in which case probi is set to 0; t-stat 2 < 0.01, in which case prob 2 is set to 0; or t-stat 3 < 0.01, 
in which case prob 3 is set to 0. 

16. The method of claim 13, wherein 

wherein for upward revisions probi is subtracted from 0.5 if ave. returni > 0, else probi is added 
to 0.5; wherein for upward revisions prob 2 is subtracted from 0.5 if ave. return 2 > 0, else prob 2 is 
added to 0.5; wherein for upward revisions prob 3 is subtracted from 0.5 if ave. return 3 > 0, else 
prob 3 is added to 0.5; wherein for downward revisions probi is subtracted from 0.5 if ave. returni 
< 0, else probi is added to 0.5; wherein for downward revisions prob 2 is subtracted from 0.5 if 
ave. return 2 < 0, else prob 2 is added to 0.5; and wherein for downward revisions prob 3 is 
subtracted from 0.5 if ave. return 3 < 0, else prob 3 is added to 0.5. 



17. The method of claim 13, wherein 
adjustment = (-20) * 



revisionsi + revisionsi + revisions3 



18. A method of evaluating an analyst's performance, said method comprising the steps of: 
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utilizing information pertaining to at least one upward or downward revision including an 
upward or downward change in opinion of the analyst with regard to the at least one investment; 

calculating a performance score indicative of the analyst's performance relative to other 
analysts, said performance score determined at least in part by considering a measure of 
variability of the analyst's performance, an average historical performance of the at least one 
investment following the at least one upward or downward revision, a standard deviation of the 
at least one upward or downward revision, a number of upward or downward revisions made by 
the analyst, and a likelihood that the at least one upward or downward revision will actually 
produce an expected result; and 

comparing the analyst's performance score against performance scores of other analysts 
to produce at least one of an upward, downward or combined revision ranking. 

19. The method of claim 18, wherein said three distinct periods of time comprise a short 
period of time which is approximately five days, an intermediate period of time which is 
approximately twenty days, and a long period of time which is approximately sixty days. 

20. The method of claim 18, wherein said performance score increases with the number of 
revisions. 

21. The method of claim 18, further comprising adjusting said performance score according 
to a modifier accentuating the number of revisions made by the analyst. 

22. The method of claim 1 8, wherein said performance score increases when a rate of return 
of the at least one investment increases and the revision is an upward revision, or when a rate of 
return of the at least one investment decreases and the revision is a downward revision, and 
wherein said performance score decreases when a rate of return of the at least one investment 
decreases and the revision is an upward revision, or when a rate of return of the at least one 
investment increases and the revision is a downward revision. 

23. The method of claim 18, further comprising adjusting said performance score according 
to a small return penalty. 
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24. The method of claim 23, wherein said small return penalty is generated by subtracting a 
penalty from an average of a first, second and third period of time return factor; wherein for 
upward revisions said penalty is 0 if an average return value corresponding to the investment for 
a long term period of time is greater than 15%, else said penalty is equal to 15% minus said 
average return value corresponding to the investment for a long term period of time; wherein for 
downward revisions said penalty is 0 if said average return value corresponding to the 
investment for a long term period of time is less than -8%, else said penalty is equal to -8% 
minus said average return value corresponding to the investment for a long term period of time; 
wherein said first period of time return factor is ten if an average return over said first period of 
time is greater than ten, else said first period of time return factor is equal to a cube root of a 
product of 100 and said average return over said first period of time; wherein said second period 
of time return factor is ten if an average return over said second period of time is greater than ten, 
else said second period of time return factor is equal to a cube root of a product of 100 and said 
average return over said second period of time; and wherein said third period of time return 
factor is ten if an average return over said third period of time is greater than ten, else said third 
period of time return factor is equal to a cube root of a product of 100 and said average return 
over said third period of time. 

25. The method of claim 18, wherein said calculating a performance score comprises: 
determining a first average return value (ave. returni), second average return value (ave. 

return 2 ), and third average return value (ave. return 3 ) for the at least one revision, said first, 
second, and third average return values corresponding respectively to an average rate of return 
on the at least one revision involving the investment for a first period of time (timeO, a second 
period of time (time 2 ), and a third period of time (time 3 ); 

calculating, in absolute terms, a first t-stat value (t-stat x ) for said first average return 
value, a second t-stat value (t-stat 2 ) for said second average return value, and a third t-stat value 
(t-stat 3 ) for said third average return value, said first, second, and third t-stat values calculated by 
utilizing said first, second, and third average return values, a first standard deviation (SD0, a 
second standard deviation (SD 2 ), and a third standard deviation (SD 3 ), a total number of 
revisions (revisionsi) occurring more than or equal to the first period of time before said 
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evaluating, a total number of revisions (revisions 2 ) occurring more than or equal to the second 
period of time before said evaluating, and a total number of revisions (revisionss) occurring more 
than or equal to the third period of time before said evaluating; 

calculating a first degree of freedom (DFO for said first average return value, a second 
degree of freedom (DF 2 ) for said second average return value, and a third degree of freedom 
(DF 3 ) for said third average return value; 

determining a first probability (probi) for said first period of time by utilizing said first t- 
stat value and said first degree of freedom, a second probability (prob 2 ) for said second period of 
time by utilizing said second t-stat value and said second degree of freedom, and a third 
probability (prob 3 ) for said third period of time by utilizing said third t-stat value and said third 
degree of freedom; and 

generating a conditional performance score (cond. performance score) for the analyst by 
utilizing probi, prob 2 , and prob 3 ,, which may be manipulated to produce said performance score. 



26. The method of claim 25, wherein if SDi = 0, then conditional performance score = 0 
otherwise 



T stat i - 



ave. returnl 



SDI 



V revisions! 



; wherein if SD 2 , = 0, then conditional performance score = 0 otherwise 

ave, return! 



T stat2 - 



SD2 



previsions! 



; wherein if SD 3 , = 0, then conditional performance score = 0 otherwise 

ave. return3 

T stats - 
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SD3 
V revisions?) 



; wherein DFi = revisions) - 1; DF 2 = revisions 2 - 1; and DF 3 = revisions 3 - 1 



27. The method of claim 25, wherein said probabilities are determined according to a 
predetermined look-up table using actual calculated values of: DFi, DF 2 , DF 3 , t-statu t-stat 2 , and 
t-stat 3 , unless: DF t > 100, in which case DFi is set to 100; DF 2 > 100, in which case DF 2 is set to 
100; DF 3 > 100, in which case DF 3 is set to 100; t-stati > 20, in which case t-stati is set to 20; t- 
stat 2 > 20, in which case t-stat 2 is set to 20; t-stat 3 > 20, in which case t-stat 3 is set to 20; t-stati < 
0.01, in which case probi is set to 0; t-stat 2 < 0.01, in which case prob 2 is set to 0; or t-stat 3 < 0.01, 
in which case prob 3 is set to 0. 

28. The method of claim 25, wherein 

t , [ [l - (-5 + or - probi)} + [l - (.5 + or - prob2)]+ [l - (.5 + or - prob3)] 1 , _ 
cond _ performance _ score ~ < - — — - — - - — - — £ *-± y* 100 

I 3 J ' 

wherein for upward revisions probi is subtracted from 0.5 if ave. returni > 0, else probi is added 
to 0.5; wherein for upward revisions prob 2 is subtracted from 0.5 if ave. return 2 > 0, else prob 2 is 
added to 0.5; wherein for upward revisions prob 3 is subtracted from 0.5 if ave. return 3 > 0, else 
prob 3 is added to 0.5; wherein for downward revisions probi is subtracted from 0.5 if ave. returni 
< 0, else probi is added to 0.5; wherein for downward revisions prob 2 is subtracted from 0.5 if 
ave. return 2 < 0, else prob 2 is added to 0.5; and wherein for downward revisions prob 3 is 
subtracted from 0.5 if ave. return 3 < 0, else prob 3 is added to 0.5. 

29. A method of evaluating an analyst's performance by utilizing information pertaining to at 
least one revision made by the analyst involving at least one investment, said method comprising 
the steps of: 

determining a first average return value (ave. returni), second average return value (ave. 
return 2 ), and third average return value (ave. return 3 ) for the at least one revision, said first, 
second, and third average return values corresponding respectively to an average rate of return 
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on the at least one revision involving the investment for a first period of time (timei), a second 
period of time (time 2 ), and a third period of time (times); 

calculating, in absolute terms, a first t-stat value (t-stati) for ave. returni , a second t-stat 
value (t-stat 2 ) for ave. return 2 , and a third t-stat value (t-stat 3 ) for ave. return 3 , said first, second, 
and third t-stat values calculated by utilizing ave. return^ ave. return^ ave. return 3 , a first 
standard deviation (SDi), a second standard deviation (SD 2 ), and a third standard deviation 
(SD 3 ), a total number of revisions (revisionsO occurring more than or equal to timei before said 
evaluating, a total number of revisions (revisions 2 ) occurring more than or equal to time 2 before 
said evaluating, and a total number of revisions (revisions 3 ) occurring more than or equal to 

10 time 3 before said evaluating; 

calculating a first degree of freedom (DFO for ave. return i, a second degree of freedom 
(DF 2 ) for ave. return 2 , and a third degree of freedom (DF 3 ) for ave. return 3 ; 

Q determining a first probability (probi) for timei by utilizing t-stati and DFi, a second 

ff* probability (prob 2 ) for time 2 by utilizing t-stat 2 and DF 2 , and a third probability (prob 3 ) for time 3 

' % z by utilizing t-stat 3 and DF 3 ; 

[J generating a raw conditional performance score for the analyst by utilizing probi, prob 2 , 

% f prob 3 ; 

C3 adding a modifier (adjustment) to the raw conditional performance score determined by 

%1 utilizing revisionsi, revisions 2 , and revisions 3 , thereby producing a conditional performance 
|§ score (cond. performance score); 

I* generating a small return penalty by subtracting a penalty from an average of return 

factors corresponding to timei, time 2 , and time 3) wherein for upward revisions said penalty is 0 if 
ave. return 3 is greater than 15%, else said penalty is equal to 15% minus ave. return 3 , wherein for 
downward revisions said penalty is 0 if ave. return 3 is less than -8%, else said penalty is equal to 
-8% minus ave. return 3 , wherein said first period of time return factor is ten if ave. returni is 
greater than ten, else said first period of time return factor is equal to a cube root of a product of 
100 and ave. returni, wherein said second period of time return factor is ten if ave. return 2 is 
greater than ten, else said second period of time return factor is equal to a cube root of a product 
of 100 and ave. return 2 , and wherein said third period of time return factor is ten if ave. return 3 is 

30 greater than ten, else said third period of time return factor is equal to a cube root of a product of 
100 and ave. return 3 ; and 



65 



26119.120 



PATENT 



generating a final performance score (performance score) indicative of said analyst's 
performance by adding said small return penalty to said conditional performance score. 

30. A system for evaluating an analyst's performance, said system comprising: 
a processor; 

a memory storing a computer program controlling operation of said processor, said 
program including instructions for causing the processor to effect: 

utilizing information pertaining to at least one revision made by the analyst involving at 
least one investment, including an upward or downward change in opinion of the analyst with 
10 regard to the at least one investment; 

calculating a conditional performance score indicative of the analyst's performance 
relative to other analysts, said raw conditional performance score determined at least in part by 
y considering a measure of variability of the analyst's performance, an average historical 
rn performance of the at least one investment following the at least one revision, a standard 
' % i deviation of the at least one revision, a number of revisions made by the analyst, and a likelihood 
|y that the at least one revision will actually produce an expected result; and 

^ adjusting said conditional performance score according to a return amount adjustment to 

5? produce a final performance score. 

|£j 31. The system of claim 30, wherein said average historical performance is calculated over 
H three distinct periods of time, which comprise a short period of time which is approximately five 

days, an intermediate period of time which is approximately twenty days, and a long period of 

time which is approximately sixty days. 

32. The system of claim 30, wherein the final performance score increases when a rate of 
return of the at least one investment increases and the revision is an upward revision, or when a 
rate of return of the at least one investment decreases and the revision is a downward revision, 
and wherein the final performance score decreases when a rate of return of the at least one 
investment decreases and the revision is an upward revision, or when a rate of return of the at 
30 least one investment increases and the revision is a downward revision. 
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33. The system of claim 30, wherein said program further comprises instructions to effect 
adjusting said conditional performance score according to a modifier accentuating the number of 
revisions made by the analyst. 

34. The system of claim 30, wherein said return amount adjustment comprises a small return 
penalty reducing said final performance score for returns on said at least one investment less than 
a predetermined amount. 

35. The system of claim 34, wherein said small return penalty is comprised of a difference 
between an average of a short period of time return factor, an intermediate period of time return 
factor, and a long period of time return factor, and a penalty; wherein said penalty is equal to 
approximately 15% for upward revisions and approximately -8% for downward revisions minus 
a return value corresponding to the investment for said long period of time; and wherein each 
period of time return factor is a cube root of a return percentage over a corresponding period of 
time. 

36. The system of claim 34, wherein said small return penalty is imposed for small returns 
over a long period of time of approximately sixty days after said at least one revision. 

37. The system of claim 34, wherein said small return penalty is generated by subtracting a 
penalty from an average of a first, second and third period of time return factor; wherein for 
upward revisions said penalty is 0 if an average return value corresponding to the investment for 
a long term period of time is greater than 15%, else said penalty is equal to 15% minus said 
average return value corresponding to the investment for a long term period of time; wherein for 
downward revisions said penalty is 0 if said average return value corresponding to the 
investment for a long term period of time is less than -8%, else said penalty is equal to -8% 
minus said average return value corresponding to the investment for a long term period of time; 
wherein said first period of time return factor is ten if an average return over said first period of 
time is greater than ten, else said first period of time return factor is equal to a cube root of a 
product of 100 and said average return over said first period of time; wherein said second period 
of time return factor is ten if an average return over said second period of time is greater than ten, 
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else said second period of time return factor is equal to a cube root of a product of 100 and said 
average return over said second period of time; and wherein said third period of time return 
factor is ten if an average return over said third period of time is greater than ten, else said third 
period of time return factor is equal to a cube root of a product of 100 and said average return 
over said third period of time. 

A system for evaluating an analyst's performance, said system comprising: 
a processor; 

a memory storing a computer program controlling operation of said processor, 
said program including instructions for causing the processor to effect: 

utilizing information pertaining to at least one upward or downward revision including an 
upward or downward change in opinion of the analyst with regard to the at least one investment; 

calculating a performance score indicative of the analyst's performance relative to other 
analysts, said performance score determined at least in part by considering a measure of 
variability of the analyst's performance, an average historical performance of the at least one 
investment following the at least one upward or downward revision, a standard deviation of the 
at least one upward or downward revision, a number of upward or downward revisions made by 
the analyst, and a likelihood that the at least one upward or downward revision will actually 
produce an expected result; and 

comparing the analyst's performance score against performance scores of other analysts 
to produce at least one of an upward, downward or combined revision ranking. 

39. The system of claim 38, wherein said program further comprises instructions to effect 
adjusting said performance score according to a modifier accentuating the number of revisions 
made by the analyst. 

40. The system of claim 38, wherein said performance score increases when a rate of return 
of the at least one investment increases and the revision is an upward revision, or when a rate of 
return of the at least one investment decreases and the revision is a downward revision, and 
wherein said performance score decreases when a rate of return of the at least one investment 
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decreases and the revision is an upward revision, or when a rate of return of the at least one 
investment increases and the revision is a downward revision. 

41 . The system of claim 38, wherein said calculating a performance score comprises: 

determining a first average return value (ave. returnO, second average return value (ave. 
return 2 ), and third average return value (ave. return 3 ) for the at least one revision, said first, 
second, and third average return values corresponding respectively to an average rate of return 
on the at least one revision involving the investment for a first period of time (timeO, a second 
period of time (time 2 ), and a third period of time (time 3 ); 
10 calculating, in absolute terms, a first t-stat value (t-stati) for said first average return 

value, a second t-stat value (t-stat 2 ) for said second average return value, and a third t-stat value 
(t-stat 3 ) for said third average return value, said first, second, and third t-stat values calculated by 
y utilizing said first, second, and third average return values, a first standard deviation (SDi), a 
f y second standard deviation (SD 2 ), and a third standard deviation (SD 3 ), a total number of 
"S revisions (revisionsi) occurring more than or equal to the first period of time before said 
W evaluating, a total number of revisions (revisions 2 ) occurring more than or equal to the second 
s~ period of time before said evaluating, and a total number of revisions (revisions 3 ) occurring more 
°*Z than or equal to the third period of time before said evaluating; 

H calculating a first degree of freedom (DFi) for said first average return value, a second 

|| degree of freedom (DF 2 ) for said second average return value, and a third degree of freedom 
?s * (DF 3 ) for said third average return value; 

determining a first probability (probi) for said first period of time by utilizing said first t- 
stat value and said first degree of freedom, a second probability (prob 2 ) for said second period of 
time by utilizing said second t-stat value and said second degree of freedom, and a third 
probability (prob 3 ) for said third period of time by utilizing said third t-stat value and said third 
degree of freedom; and 

generating a conditional performance score (cond. performance score) for the analyst by 
utilizing probi, prob 2 , and prob 3) , which may be manipulated to produce said performance score. 

30 42. The system of claim 41 , wherein if SDi = 0, then conditional performance score = 0 
otherwise 
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T stat\ - 



ave. returnl 



SDl 



V revisionsi 



; wherein if SD 2 , = 0, then conditional performance score = 0 otherwise 

ave. returnl 



T stah — 



SDl } 



V revisionsi 



; wherein if SD3, = 0, then conditional performance score = 0 otherwise 

ave. return3 



Tstati = 



SD3 



V revisions^ 



; wherein DFi = revisionsi - 1; DF 2 = revisions 2 - 1; and DF 3 = revisions 3 - 1 



43. The system of claim 41, wherein said probabilities are determined according to a 
predetermined look-up table using actual calculated values of: DFi, DF 2 , DF 3 , t-stati, t-stat 2 , and 
t-stat 3? unless: DFi > 100, in which case DFi is set to 100; DF 2 > 100, in which case DF 2 is set to 
100; DF 3 > 100, in which case DF 3 is set to 100; t-stati > 20, in which case t-stati is set to 20; t- 
stat 2 > 20, in which case t-stat 2 is set to 20; t-stat 3 > 20, in which case t-stat 3 is set to 20; t-stati < 
0.01, in which case probi is set to 0; t-stat 2 < 0.01, in which case prob 2 is set to 0; or t-stat 3 < 0.01, 
in which case prob 3 is set to 0. 



44. The system of claim 41, wherein 
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f [l - (.5 + or - probl)] + [l - (.5 + or - prob2 )]+ [l - (.5 + or - prob3)] . 
cond _ performance _ score = < r AUU 



wherein for upward revisions probi is subtracted from 0.5 if ave. returni > 0, else probi is added 
to 0.5; wherein for upward revisions prob 2 is subtracted from 0.5 if ave. return 2 > 0, else prob 2 is 
added to 0.5; wherein for upward revisions prob 3 is subtracted from 0.5 if ave. return 3 > 0, else 
prob 3 is added to 0.5; wherein for downward revisions probi is subtracted from 0.5 if ave. returni 
< 0, else probi is added to 0.5; wherein for downward revisions prob 2 is subtracted from 0.5 if 
ave. return 2 < 0, else prob 2 is added to 0.5; and wherein for downward revisions prob 3 is 
subtracted from 0.5 if ave. return 3 < 0, else prob 3 is added to 0.5. 



10 45. A system for evaluating an analyst's performance, said system comprising: 

^ means for utilizing information pertaining to at least one revision made by the analyst 

I H involving at least one investment, including an upward or downward change in opinion of the 
o analyst with regard to the at least one investment; 

^ means for calculating a conditional performance score indicative of the analyst's 

M performance relative to other analysts, said raw conditional performance score determined at 

13 least in part by considering a measure of variability of the analyst's performance, an average 

Tl historical performance of the at least one investment following the at least one revision, a 

£3 standard deviation of the at least one revision, a number of revisions made by the analyst, and a 

11 likelihood that the at least one revision will actually produce an expected result; and 

20 means for adjusting said conditional performance score according to a return amount 

adjustment to produce a final performance score. 

46. The system of claim 45, wherein said average historical performance is calculated over 
three distinct periods of time, which comprise a short period of time which is approximately five 
days, an intermediate period of time which is approximately twenty days, and a long period of 
time which is approximately sixty days. 

47. The system of claim 45, wherein the final performance score increases when a rate of 
return of the at least one investment increases and the revision is an upward revision, or when a 

30 rate of return of the at least one investment decreases and the revision is a downward revision, 
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and wherein the final performance score decreases when a rate of return of the at least one 
investment decreases and the revision is an upward revision, or when a rate of return of the at 
least one investment increases and the revision is a downward revision. 

48. The system of claim 45, further comprising means for adjusting said conditional 
performance score according to a modifier accentuating the number of revisions made by the 
analyst. 

49. The system of claim 45, wherein said return amount adjustment comprises a small return 
penalty reducing said final performance score for returns on said at least one investment less than 
a predetermined amount. 

50. The system of claim 49, wherein said small return penalty is comprised of a difference 
between an average of a short period of time return factor, an intermediate period of time return 
factor, and a long period of time return factor, and a penalty; wherein said penalty is equal to 
approximately 15% for upward revisions and approximately -8% for downward revisions minus 
a return value corresponding to the investment for said long period of time; and wherein each 
period of time return factor is a cube root of a return percentage over a corresponding period of 
time. 

51. The system of claim 49, wherein said small return penalty is imposed for small returns 
over a long period of time of approximately sixty days after said at least one revision. 

52. The system of claim 49, wherein said small return penalty is generated by subtracting a 
penalty from an average of a first, second and third period of time return factor; wherein for 
upward revisions said penalty is 0 if an average return value corresponding to the investment for 
a long term period of time is greater than 15%, else said penalty is equal to 15% minus said 
average return value corresponding to the investment for a long term period of time; wherein for 
downward revisions said penalty is 0 if said average return value corresponding to the 
investment for a long term period of time is less than -8%, else said penalty is equal to -8% 
minus said average return value corresponding to the investment for a long term period of time; 
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wherein said first period of time return factor is ten if an average return over said first period of 
time is greater than ten, else said first period of time return factor is equal to a cube root of a 
product of 100 and said average return over said first period of time; wherein said second period 
of time return factor is ten if an average return over said second period of time is greater than ten, 
else said second period of time return factor is equal to a cube root of a product of 100 and said 
average return over said second period of time; and wherein said third period of time return 
factor is ten if an average return over said third period of time is greater than ten, else said third 
period of time return factor is equal to a cube root of a product of 100 and said average return 
over said third period of time. 

10 

53. A system for evaluating an analyst's performance, said system comprising: 

means for utilizing information pertaining to at least one upward or downward revision 
Q including an upward or downward change in opinion of the analyst with regard to the at least one 
ry investment; 

M means for calculating a performance score indicative of the analyst's performance 

|y relative to other analysts, said performance score determined at least in part by considering a 
]** measure of variability of the analyst's performance, an average historical performance of the at 
*3 least one investment following the at least one upward or downward revision, a standard 
!U deviation of the at least one upward or downward revision, a number of upward or downward 
|fi revisions made by the analyst, and a likelihood that the at least one upward or downward 
H revision will actually produce an expected result; and 

means for comparing the analyst's performance score against performance scores of other 
analysts to produce at least one of an upward, downward or combined revision ranking. 

54. The system of claim 53, further comprising means for adjusting said performance score 
according to a modifier accentuating the number of revisions made by the analyst. 

55. The system of claim 53, wherein said performance score increases when a rate of return 
of the at least one investment increases and the revision is an upward revision, or when a rate of 

30 return of the at least one investment decreases and the revision is a downward revision, and 
wherein said performance score decreases when a rate of return of the at least one investment 
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decreases and the revision is an upward revision, or when a rate of return of the at least one 
investment increases and the revision is a downward revision. 

56. The system of claim 53, wherein said calculating a performance score comprises: 

determining a first average return value (ave. returni), second average return value (ave. 
return 2 ), and third average return value (ave. return 3 ) for the at least one revision, said first, 
second, and third average return values corresponding respectively to an average rate of return 
on the at least one revision involving the investment for a first period of time (timeO, a second 
period of time (time 2 ), and a third period of time (times); 
10 calculating, in absolute terms, a first t-stat value (t-stati) for said first average return 

value, a second t-stat value (t-stat 2 ) for said second average return value, and a third t-stat value 
(t-stat 3 ) for said third average return value, said first, second, and third t-stat values calculated by 
u utilizing said first, second, and third average return values, a first standard deviation (SDi), a 
f H second standard deviation (SD 2 ), and a third standard deviation (SD 3 ), a total number of 
%J revisions (revisionsO occurring more than or equal to the first period of time before said 
|y evaluating, a total number of revisions (revisions 2 ) occurring more than or equal to the second 
" " period of time before said evaluating, and a total number of revisions (revisions 3 ) occurring more 
CJ than or equal to the third period of time before said evaluating; 

:U calculating a first degree of freedom (DFi) for said first average return value, a second 

%t degree of freedom (DF 2 ) for said second average return value, and a third degree of freedom 
jU (DF 3 ) for said third average return value; 

determining a first probability (probi) for said first period of time by utilizing said first t- 
stat value and said first degree of freedom, a second probability (prob 2 ) for said second period of 
time by utilizing said second t-stat value and said second degree of freedom, and a third 
probability (prob 3 ) for said third period of time by utilizing said third t-stat value and said third 
degree of freedom; and 

generating a conditional performance score (cond. performance score) for the analyst by 
utilizing probi, prob 2 , and prob 3 ,, which may be manipulated to produce said performance score. 

30 57. The system of claim 56, wherein if SDi = 0, then conditional performance score = 0 
otherwise 
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T stat i 



ave. returnl 



SD1 



V revisions! 



wherein if SD2, = 0, then conditional performance score = 0 otherwise 

ave. return! 



T stat2 - 



SD! 



V revisions! 



; wherein if SD3, = 0, then conditional performance score = 0 otherwise 

ave. return3 



T stat-$ 



SD3 



V revisions^ 



wherein DFi = revisionsi - 1; DF2= revisions2 - 1; and DF3 = revisions3 - 1 



58. The system of claim 56, wherein said probabilities are determined according to a 
predetermined look-up table using actual calculated values of: DFi, DF 2 , DF3, t-stati, t-stat2, and 
t-stat 3 , unless: DFi > 100, in which case DFi is set to 100; DF 2 > 100, in which case DF 2 is set to 
100; DF 3 > 100, in which case DF3 is set to 100; t-stati > 20, in which case t-stati is set to 20; t- 
stat 2 > 20, in which case t-stat 2 is set to 20; t-stat3 > 20, in which case t-stat3 is set to 20; t-stati < 
0.01, in which case probi is set to 0; t-stat 2 < 0.01, in which case prob 2 is set to 0; or t-stat3 < 0.01, 
in which case prob3 is set to 0. 



59. The system of claim 56, wherein 



75 



26119.120 



PATENT 



f [l - (.5 + or - probl)] + [l - (.5 + or - prob2)]+ [l - (.5 + or - prob3)} 1 . 
con d _ performance __ score = < ~ — - — - — > * 



100 



wherein for upward revisions probi is subtracted from 0.5 if ave. returni > 0, else probi is added 
to 0.5; wherein for upward revisions prob2 is subtracted from 0.5 if ave. return > 0, else prob2 is 
added to 0.5; wherein for upward revisions prob3 is subtracted from 0.5 if ave. returns > 0, else 
prob3 is added to 0.5; wherein for downward revisions probi is subtracted from 0.5 if ave. returni 
< 0, else probi is added to 0.5; wherein for downward revisions prob2 is subtracted from 0.5 if 
ave. return 2 < 0, else prob 2 is added to 0.5; and wherein for downward revisions prob3 is 
subtracted from 0.5 if ave. returns < 0, else prob3 is added to 0.5. 



60. A computer data signal embodied in a carrier wave, said signal bearing instructions for 
causing a computer system to evaluate an analyst's performance, said instructions comprising: 

utilizing information pertaining to at least one revision made by the analyst involving at 
least one investment, including an upward or downward change in opinion of the analyst with 
regard to the at least one investment; 

calculating a conditional performance score indicative of the analyst's performance 
relative to other analysts, said raw conditional performance score determined at least in part by 
considering a measure of variability of the analyst's performance, an average historical 
performance of the at least one investment following the at least one revision, a standard 
deviation of the at least one revision, a number of revisions made by the analyst, and a likelihood 
that the at least one revision will actually produce an expected result; and 

adjusting said conditional performance score according to a return amount adjustment to 
produce a final performance score. 

61. The signal of claim 60, wherein the final performance score increases when a rate of 
return of the at least one investment increases and the revision is an upward revision, or when a 
rate of return of the at least one investment decreases and the revision is a downward revision, 
and wherein the final performance score decreases when a rate of return of the at least one 
investment decreases and the revision is an upward revision, or when a rate of return of the at 
least one investment increases and the revision is a downward revision. 



76 



26119.120 



PATENT 



62. The signal of claim 60, wherein said return amount adjustment comprises a small return 
penalty reducing said final performance score for returns on said at least one investment less than 
a predetermined amount. 

63. The signal of claim 62, wherein said small return penalty is comprised of a difference 
between an average of a short period of time return factor, an intermediate period of time return 
factor, and a long period of time return factor, and a penalty; wherein said penalty is equal to 
approximately 15% for upward revisions and approximately -8% for downward revisions minus 
a return value corresponding to the investment for said long period of time; and wherein each 

10 period of time return factor is a cube root of a return percentage over a corresponding period of 
time. 

J % 64. The signal of claim 62, wherein said small return penalty is generated by subtracting a 
I U penalty from an average of a first, second and third period of time return factor; wherein for 
3 « upward revisions said penalty is 0 if an average return value corresponding to the investment for 
^% a long term period of time is greater than 15%, else said penalty is equal to 15% minus said 
s average return value corresponding to the investment for a long term period of time; wherein for 
Jz downward revisions said penalty is 0 if said average return value corresponding to the 
12 investment for a long term period of time is less than -8%, else said penalty is equal to -8% 
10 minus said average return value corresponding to the investment for a long term period of time; 
wherein said first period of time return factor is ten if an average return over said first period of 
time is greater than ten, else said first period of time return factor is equal to a cube root of a 
product of 100 and said average return over said first period of time; wherein said second period 
of time return factor is ten if an average return over said second period of time is greater than ten, 
else said second period of time return factor is equal to a cube root of a product of 100 and said 
average return over said second period of time; and wherein said third period of time return 
factor is ten if an average return over said third period of time is greater than ten, else said third 
period of time return factor is equal to a cube root of a product of 100 and said average return 
over said third period of time. 

30 
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65. A computer data signal embodied in a carrier wave, said signal bearing instructions for 
causing a computer system to evaluate an analyst's performance, said instructions comprising: 

utilizing information pertaining to at least one upward or downward revision including an 
upward or downward change in opinion of the analyst with regard to the at least one investment; 

calculating a performance score indicative of the analyst's performance relative to other 
analysts, said performance score determined at least in part by considering a measure of 
variability of the analyst's performance, an average historical performance of the at least one 
investment following the at least one upward or downward revision, a standard deviation of the 
at least one upward or downward revision, a number of upward or downward revisions made by 
10 the analyst, and a likelihood that the at least one upward or downward revision will actually 

produce an expected result; and 
13 comparing the analyst's performance score against performance scores of other analysts 

1% to produce at least one of an upward, downward or combined revision ranking. 

B ; 66. The signal of claim 65, further comprising instructions for adjusting said performance 
^ score according to a modifier accentuating the number of revisions made by the analyst. 

jz 67. The signal of claim 65, wherein said calculating a performance score comprises: 

12 determining a first average return value (ave. returnO, second average return value (ave. 

1Q retun^), and third average return value (ave. returns) for the at least one revision, said first, 

second, and third average return values corresponding respectively to an average rate of return 
on the at least one revision involving the investment for a first period of time (timei), a second 
period of time (time 2 ), and a third period of time (time 3 ); 

calculating, in absolute terms, a first t-stat value (t-stati) for said first average return 
value, a second t-stat value (t-stat2) for said second average return value, and a third t-stat value 
(t-stat3) for said third average return value, said first, second, and third t-stat values calculated by 
utilizing said first, second, and third average return values, a first standard deviation (SDi), a 
second standard deviation (SD 2 ), and a third standard deviation (SD 3 ), a total number of 
revisions (revisions 0 occurring more than or equal to the first period of time before said 

30 evaluating, a total number of revisions (revisions2) occurring more than or equal to the second 
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period of time before said evaluating, and a total number of revisions (revisions3) occurring more 
than or equal to the third period of time before said evaluating; 

calculating a first degree of freedom (DFi) for said first average return value, a second 
degree of freedom (DF2) for said second average return value, and a third degree of freedom 
(DF3) for said third average return value; 

determining a first probability (probi) for said first period of time by utilizing said first t- 
stat value and said first degree of freedom, a second probability (prob2) for said second period of 
time by utilizing said second t-stat value and said second degree of freedom, and a third 
probability (prob3> for said third period of time by utilizing said third t-stat value and said third 
degree of freedom; and 

generating a conditional performance score (cond. performance score) for the analyst by 
utilizing probi, prob 2 , and prob^, which may be manipulated to produce said performance score. 

68. A computer readable medium storing instructions executable by a computer, the 
instructions for instructing the computer to effect evaluating an analyst's performance, said 
instructions comprising: 

utilizing information pertaining to at least one revision made by the analyst involving at 
least one investment, including an upward or downward change in opinion of the analyst with 
regard to the at least one investment; 

calculating a conditional performance score indicative of the analyst's performance 
relative to other analysts, said raw conditional performance score determined at least in part by 
considering a measure of variability of the analyst's performance, an average historical 
performance of the at least one investment following the at least one revision, a standard 
deviation of the at least one revision, a number of revisions made by the analyst, and a likelihood 
that the at least one revision will actually produce an expected result; and 

adjusting said conditional performance score according to a return amount adjustment to 
produce a final performance score. 

69. The computer readable medium of claim 68, wherein the final performance score 
increases when a rate of return of the at least one investment increases and the revision is an 
upward revision, or when a rate of return of the at least one investment decreases and the 
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revision is a downward revision, and wherein the final performance score decreases when a rate 
of return of the at least one investment decreases and the revision is an upward revision, or when 
a rate of return of the at least one investment increases and the revision is a downward revision. 

70. The computer readable medium of claim 68, wherein said return amount adjustment 
comprises a small return penalty reducing said final performance score for returns on said at least 
one investment less than a predetermined amount. 

7 1 . The computer readable medium of claim 70, wherein said small return penalty is 
comprised of a difference between an average of a short period of time return factor, an 
intermediate period of time return factor, and a long period of time return factor, and a penalty; 
wherein said penalty is equal to approximately 15% for upward revisions and approximately - 
8% for downward revisions minus a return value corresponding to the investment for said long 
period of time; and wherein each period of time return factor is a cube root of a return percentage 
over a corresponding period of time. 

72. The computer readable medium of claim 70, wherein said small return penalty is 
generated by subtracting a penalty from an average of a first, second and third period of time 
return factor; wherein for upward revisions said penalty is 0 if an average return value 
corresponding to the investment for a long term period of time is greater than 15%, else said 
penalty is equal to 15% minus said average return value corresponding to the investment for a 
long term period of time; wherein for downward revisions said penalty is 0 if said average return 
value corresponding to the investment for a long term period of time is less than -8%, else said 
penalty is equal to -8% minus said average return value corresponding to the investment for a 
long term period of time; wherein said first period of time return factor is ten if an average return 
over said first period of time is greater than ten, else said first period of time return factor is 
equal to a cube root of a product of 100 and said average return over said first period of time; 
wherein said second period of time return factor is ten if an average return over said second 
period of time is greater than ten, else said second period of time return factor is equal to a cube 
root of a product of 100 and said average return over said second period of time; and wherein 
said third period of time return factor is ten if an average return over said third period of time is 
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greater than ten, else said third period of time return factor is equal to a cube root of a product of 
100 and said average return over said third period of time. 

73. A computer readable medium storing instructions executable by a computer, the 
instructions for instructing the computer to effect evaluating an analyst's performance, said 
instructions comprising: 

utilizing information pertaining to at least one upward or downward revision including an 
upward or downward change in opinion of the analyst with regard to the at least one investment; 

calculating a performance score indicative of the analyst's performance relative to other 
analysts, said performance score determined at least in part by considering a measure of 
variability of the analyst's performance, an average historical performance of the at least one 
investment following the at least one upward or downward revision, a standard deviation of the 
at least one upward or downward revision, a number of upward or downward revisions made by 
the analyst, and a likelihood that the at least one upward or downward revision will actually 
produce an expected result; and 

comparing the analyst's performance score against performance scores of other analysts 
to produce at least one of an upward, downward or combined revision ranking. 

74. The computer readable medium of claim 73, further comprising adjusting said 
performance score according to a modifier accentuating the number of revisions made by the 
analyst. 

75. The computer readable medium of claim 73, wherein said calculating a performance 
score comprises: 

determining a first average return value (ave. returnO, second average return value (ave. 
return), and third average return value (ave. returns) for the at least one revision, said first, 
second, and third average return values corresponding respectively to an average rate of return 
on the at least one revision involving the investment for a first period of time (timei), a second 
period of time (time^, and a third period of time (times); 

calculating, in absolute terms, a first t-stat value (t-stati) for said first average return 
value, a second t-stat value (t-stat 2 ) for said second average return value, and a third t-stat value 
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(t-stat 3 ) for said third average return value, said first, second, and third t-stat values calculated by 
utilizing said first, second, and third average return values, a first standard deviation (SDi), a 
second standard deviation (SD2), and a third standard deviation (SD3), a total number of 
revisions (revisions 0 occurring more than or equal to the first period of time before said 
evaluating, a total number of revisions (revisions 2 ) occurring more than or equal to the second 
period of time before said evaluating, and a total number of revisions (revisions 3 ) occurring more 
than or equal to the third period of time before said evaluating; 

calculating a first degree of freedom (DFi) for said first average return value, a second 
degree of freedom (DF 2 ) for said second average return value, and a third degree of freedom 
10 (DF3) for said third average return value; 

determining a first probability (probi) for said first period of time by utilizing said first t- 
^ stat value and said first degree of freedom, a second probability (prob 2 ) for said second period of 
v3 time by utilizing said second t-stat value and said second degree of freedom, and a third 
f y probability (prob3> for said third period of time by utilizing said third t-stat value and said third 
: f degree of freedom; and 

lu generating a conditional performance score (cond. performance score) for the analyst by 

s" utilizing probi, prob 2 , and prob3,, which may be manipulated to produce said performance score. 

H 76. A method of evaluating an analyst's performance, said method comprising: 
JO a step for utilizing information pertaining to at least one revision made by the analyst 

H involving at least one investment, including an upward or downward change in opinion of the 
analyst with regard to the at least one investment; 

a step for calculating a conditional performance score indicative of the analyst's 
performance relative to other analysts, said raw conditional performance score determined at 
least in part by considering a measure of variability of the analyst's performance, an average 
historical performance of the at least one investment following the at least one revision, a 
standard deviation of the at least one revision, a number of revisions made by the analyst, and a 
likelihood that the at least one revision will actually produce an expected result; and 

a step for adjusting said conditional performance score according to a return amount 
30 adjustment to produce a final performance score. 
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77. A method of evaluating an analyst's performance, said method comprising: 

a step for utilizing information pertaining to at least one upward or downward revision 
including an upward or downward change in opinion of the analyst with regard to the at least one 
investment; 

a step for calculating a performance score indicative of the analyst's performance relative 
to other analysts, said performance score determined at least in part by considering a measure of 
variability of the analyst's performance, an average historical performance of the at least one 
investment following the at least one upward or downward revision, a standard deviation of the 
at least one upward or downward revision, a number of upward or downward revisions made by 
the analyst, and a likelihood that the at least one upward or downward revision will actually 
produce an expected result; and 

a step for comparing the analyst's performance score against performance scores of other 
analysts to produce at least one of an upward, downward or combined revision ranking. 
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